COMPOSITION OPERATORS ON THE BERGMAN SPACES OF A 
MINIMAL BOUNDED HOMOGENEOUS DOMAIN 



SATOSHI YAMAJI 

Abstract. Using an integral formula on a homogeneous Siegel domain, we show a 
necessary and sufficient condition for composition operators on the weighted Bergman 
space of a minimal bounded homogeneous domain to be compact. To describe the 
compactness of composition operators, we sec a boundary behavior of the Bergman 
kernel. 



1. Introduction 

In 2007, Zhu [13] considered the composition operators on the weighted Bergman space 
of the unit ball. His results are extended to the case that the domain is the Harish- 
Chandra realization of irreducible bounded symmetric domain by Lu and Hu [8]. In this 
paper, we consider a generalization of their works for the weighted Bergman space of 
a minimal bounded homogeneous domain (for the definition of the mininal domain, see 
[7], [H]). Indeed, the unit ball, the polydisk and a bounded symmetric domain in its 
Harish- Chandra realization are minimal domains. 

Let W be a minimal bounded homogeneous domain in C^, dV{z) the Lebesgue measure 
on and 0(U) the space of all holomorphic functions on U. The Bergman kernel Ku : 
U X U — >■ C is the reproducing kernel of the Bergman space Ll{U,dV) := L'^(U,dV) fl 
0{U). The Bergman kernel is a useful tool to study properties of composition operators, 
Toeplitz operators and Hankel operators on the Bergman space (for example, see [T2]). 
In this paper, we see that a necessary and sufficient condition for a bounded composition 
operator to be compact is described by a boundary behavior of the Bergman kernel. 

For G M, let dVp denote the measure on U given by dVp{z) := Kn{z, z)~'^dV{z). We 
consider the weighted Bergman space L'^iU, (iVg) := Lp(U, dVp) fl 0{U). It is known that 
there exists a constant /^min such that L^{U, dVa) is non-trivial if and only if /3 > P^^^ (for 
explicit expression of /3min, see section ISTTl) . From now on, we consider non-trivial weighted 
Bergman spaces. For a holomorphic map (p from U to U, the composition operator dp is 
a linear operator on 0(U) defined by C<^/ := f o ip. We conside the composition operator 
on the weighted Bergman space L^{U,dVi3). Using Zhu's technique (see [13]) together 
with an integral formula (see Lemma [5.21) . we obtain the following theorem, which is the 
main theorem of this paper. 

Theorem A (Theorem 16. II) . Assume that is bounded on L1{U, dVpf^) for some q > 
and /?o > /?min- Then is compact on L^(U, dVjs) for any p > and /3 > /3o + Ant if and 



2000 Mathematics Subject Classification. Primary 47B33; Secondary 47B35, 32A25. 
Key words and phrases, composition operator, Bergman space, bounded homogeneous domain, 
mal domain, Carleson measure. 

1 



2 



S. YAMAJI 



only if 



z^du Ku{z,z) 



0. 



Since the unit ball and the Harish-Chandra realization of irreducible bounded symmet- 
ric domain are minimal domains, Theorem |X] is a generalization of [TU Theorem 4.1] and 
[8], Theorem] (see section [7]). Similarly to the case of them, the assumption that C^p is a 
bounded operator on L^{U,dVi3Q) for some /3o > Anin is needed only for the "if" part of 
Theorem |X1 

To prove Theorem |X] for the case that U = B'^, Zhu used Schur's theorem. To apply 
Zhu's method, it is important to find a positive function satisfying a certain inequality. 
Zhu found this function by using Forelli-Rudin inequality (see [TU Lemma 2.6]). Instead, 
we find the function by using Lemma 15.21 By [10] , there exists a biholomorphic map 
$ from the bounded homogeneous domain U onto a homogeneous Siegel domain V. In 
Lemma [5. 2 [ we shall consider the integral 



where J{^, z') denotes the complex Jacobi matrix of $ at z'. The integral converges if 
and only if /3 > /3min and a > (3 + /3int, where (3int is a constant defined from U (see section 



Before the proof of theorem |X1 we show that the boundedness of C<^ on L^^iU , dVi^) is 
described in terms of Carleson measures. It is easy to see that is a bounded operator 
on LP(U, dVis) if and only if the pull-back measure (i/i<^,^ of dVp induced by is a Carleson 
measure for L^iU, dVp) (see section H?T1) . Using properties of Carleson measures, we obtain 
the following theorem. 

Theorem B (Theorems 14.31 and 14. 5p . If C^p is a bounded (resp. compact) operator on 
Ll(U, rfV^o) f^"^ some q > and (3o > /3min, then is a bounded (resp. compact) operator 
on L'P(U, dVfs) for any p > and f3 > f3o. 

By TheoremlHl the assumption of Theorem Rl implies that is bounded on L^U, (iV^g) 
for any q > and f3 > Pq. We use the boundedness of on Ll{U, (iVg) and L\{U, dVp^^) 
in section 16. 2[ 

Let us explain the organization of this paper. In section [2], we review properties of the 
weighted Bergman space of a minimal bounded homogeneous domain and composition 
operators on the space. Theorem 12.11 plays an important role in this section. In section 
[3l we show some properties of Carleson measures and vanishing Carleson measures for 
the weighted Bergman space of a minimal bounded homogeneous domain (Theorems 13.21 
and 13.31) . Using them, we prove properties of the boundedness and compactness of in 
section HI (Theorems 14.31 and 14.51) . In sectional we show an important equality (Lemma 
15. 2p . By using Lemma 15.21 we prove the characterization of the compactness of the 
composition operator (Theorem [A]) in section [61 In section [71 we apply Theorem [X] for the 
case that U is the unit ball, bounded symmetric domain in its Harish-Chandra realization, 
the polydisk and the representative domain of the tube domain over Vinberg cone, which is 
an example of nonsymmetric bounded homogeneous domain. These domains are minimal 
domains with a center 0. 
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2. Preliminaries 



2.1. Weighted Bergman spaces of a minimal bounded homogeneous domain. 

Let D he a. bounded domain in C''. We say that D is a minimal domain with a center 
t G -D if the following condition is satisfied: for every biholomorphism ip : D — y D' with 
det J{'ip^ i) = 1, we have 

Vol(D') > Yo\{D). 
We see that D is a minimal domain with a center t if and only if 

for any z E D (see |6l Proposition 3.6] or |9l Theorem 3.1]). For example, the unit disk 
D and the unit ball B*^ are minimal domains with a center 0. 

We fix a minimal bounded homogeneous domain lA with a center t. We denote by 
the reproducing kernel of L'^{U,dVp). It is known that 



U ' 



U 



C^Ku{z,wy+^ for 

some positive constant C/?. For z E U, we denote by ki^^ the normalized reproducing 
kernel of Ll(U, dVis), that is, 



w] 



For any Borel set E' in W, we define 



Ku{u),z) 



(2.1) 



Vol;3 (E) 



Let d, 



UK 



be the Bergman distance on U. For any z ElA and r > 0, let 



B{z, r) := {w \ du{z, w) < r} 

be the Bergman metric disk with center z and radius r. 
In [7], we proved the following theorem. 

Theorem 2.1 ([7J Theorem A]). For any p > 0, there exists Cp > such that 

Ku(z,a) 



< a 



Ku{a,a) 

for all z,a eU such that du{z, a) < p. 

From Theorem 12. 11 we obtain that Ku{--, a) is a bounded function on U for each a eU 
(see [71 Proposition 6.1]). Since span(A'^''^(-, a)) is dense in Ll{U, rfV^), we see that H°^{U) 
is dense in L^(W,(iV^), where H°°{U) is the set of all bounded holomorphic functions on 
U. 

Moreover, we obtain useful lemmas from Theorem 12.11 First, we deduce 

Ku{z,z) 



for all z,a eU such that dij{z, a) < p. On the other hand, we have 

2 



(2.2) 



CKuia^a)-' < 



Ku{z,a) 
Kuia, a) 



Vol {B (a, p)) <CKu{a, a) 
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by [m Lemma 3.3]. Therefore, we have 

C~^Ku{a,aY^ < Vol (5(a,p)) < CKu{a,a)~^ 
by Theorem 12. 1[ Therefore, we have the following lemma. 
Lemma 2.2. There exists a positive constant C such that 

C-'Ku{a, a)-(i+^) < Vol^ {B{a, p)) < CKu{a, a)-^'+^^ 

for all a eU. 
Proof. Since 

VoV(5(a,p))= f Ku{w,w)-^dV{w), 

JB{a,p) 

we have 

C-^Ku{a, a)-^Vol (5(a, p)) < Vol^ (5(a, p)) < CKu{a, ay^^Vol {B{a, p)) . 
by dOD. We obtain ([23D from and fl^ . 

By (12. ip , Lemma 12.21 and Theorem 12.11 we have the following lemma. 
Lemma 2.3 (cf. [121 Lemma 1]). There exists a positive constant C such that 

C-^<\ki^\z)\\o\p{B{a,p))<C 
for all a eU and z G -B(a, p) . 

Lemma 12.21 and (12. 3p yield the following; 
Lemma 2.4 (cf. [121 Lemma 2]). There exists a positive constant C such that 

Cr^Nolp {B{a,p)) < Vo\^ {B{z,p)) < CVol^ {B{a,p)) 
for all a eU and z G B{a, p) . 

We have the following estimate. 
Lemma 2.5 (cf. [T2l Lemma 5]). There exists a positive constant C such that 

Yo\p{B[z,p)) Js^. p) 
for all f G 0{U),p > and z eU. 

Proof. By [TTl Lemma 3.5], there exists a C > such that 

Vol (5(2, p)) Jb^,^p^ 
Vol(S(2,p)) 

where the lat inequality follows from (12. 2p . By (12. 5p . we have 

Kuiz,z)P ^ C 
Vol (5(2, p)) - Vol;, (5(2, p))- 

Hence, we obtain fl2.6D. 
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2.2. Composition operator. In this section, we summarize properties of the composi- 
tion operator (see also [T^ section 11], [S]). Let ip he a holomorphic map from U to U. 
For / G 0(U), we define C^f := f o tp. Then, is a hnear operator on 0(U). The 
operator is called the composition operator induced by tp. It is known that is 
always bounded on L^(U, dVg) for the case that U is the unit disk D. However, for a gen- 
eral minimal bounded homogeneous domain U, a composition operator is not necessarily 
bounded on L^iU^dVis) (for example, see [H]). 

On the other hand, for any Borel set E in U, we define 

The measure fi^^js is called the pull-back measure of dV^ induced by tp. Then, is a 
bounded operator on Lp{U, dVp) if and only if there exists a constant C > such that 



\f{w)f dfi^A^) < C / \f{w)\^ dVp{w) (2.7) 
u Ju 

holds for any f e W^iU.dVp). 

Assume that is a bounded operator on Ll{U, dV/^). Then, we have 

C;f{w) = {C;f, KL^^)LHdv,) = if, C^/^i«>^.(,^^) (2.8) 

for any / G Ll^{U,dVp). Therefore, we have 

C^C;f{w) = (/,C^<i))i.(,v,) = / K^f\p{w),p{u))f{u)dVp{u). (2.9) 

We use (12. 9p to characterize the compactness of C^. Moreover, we have 

f{p{u))Ki;\w,p{u))dVp{u) 
Ku\w,u)f{u)dfi^Au) 

lU 

by (12.81) . Therefore, we obtain C*C<^ = T^^^, where T)^^^ is the Toeplitz operator with 
symbol fi^^^. The boundedness of Toeplitz operators are discussed in [11], [131 section 7] 
and [H]. 

3. CaRLESON measures AND VANISHING CaRLESON MEASURES 

3.1. Berezin symbol and averaging function. For a Borel measure fi onU, we define 
a function /I on W by 

]liz) := / \kif'\w)\'df^{w), 



u 



JU 

which is called the Berezin symbol of the measure For fixed p > 0, we define a function 
/i on W by 

Vol,(S(z,p))' 

which is called the averaging function of the Borel measure Although the value of /2 
depends on the parameter p, we will ignore that distinction. 
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Lemma 3.1. There exists a positive constant C such that 

\fiz)f df,iz)<c [ m\mr dv,{z) 

u Ju 
for any p > and f G 0{U). 

Proof. By Lemma [2.51 we have 



\f{z)\^ d^,{z) <C I / \f{w)f dV,{w) df,{z) (3.1) 

U Ju \^Oli3[B{Z,p)) Jb(z,p) J 

for any p > and / G 0(U). The right hand side of (13. ip is equal to 

By using Fubini's theorem, (13. 2p is equal to 

C I (I ,1, ,, d^,{z)\ \f{w)r dV,{w). (3.3) 

By Lemma 12.41 (13.30 is less than or equal to 



Ju Vol^ {B[w,p)) 



□ 



3.2. Carleson measures. Let yU be a positive Borel measure on U and p > 0. We say 
that ^ is a Carleson measure for L^(U, dV^) if there exists a constant M > such that 



\f{z)\Pdfi{z)<M / \f{z)\''dVp{z) 

U JU 

for all / G L^iU, dVjs). It is easy to see that /u is a Carleson measure for L^(U, dV^) if and 
only if LP(U, (iVg) C L^iU, dp) and the inclusion map 

ip:Ll{U,dVp)^Ll{U,dp) 

is bounded. 

The following theorem is a generalization of [121 Theorem 7] to a minimal bounded 
homogeneous domain. 

Theorem 3.2. Let p be a positive Borel measure on U. Then, the following conditions 
are all equivalent. 

(i) p is a Carleson measure for L^{U,dVfs). 
(a) p, is a bounded function onU. 
(Hi) p is a bounded function onlA. 

Proof. First, we prove (z) =^ (ii). Since ki^\w)p G L^(W,(fVg) and p is a Carleson 
measure for U^iU , dVp) we have 

\kf\w)\^ dp{w) <M I \kf\w)f dVp{w) = M. 
u Ju 
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Therefore, Ji is bounded. Next, we prove (ii) =^ {Hi). Take any w ElA. By Lemma [2.3[ 
there exists a positive constant C such that 

C<\k'^i\w)\^Yo\p{B{w,p)) (3.4) 
holds for any w G B{z, p). We integrate fl3.4p on B{z^ p) by dp. Then, we have 



l^{B{z,p)) 
Yo\p{B{z,p)) 




Therefore, we have 

p{z)<Cp{z). (3.6) 
Hence, [ii) =^ {Hi) holds. The part {in) =^ {i) follows from Lemma [3.11 □ 

Similarly to [TTl Theorem 4.1], we can prove that these conditions are equivalent to the 
following condition: (iv) The Toeplitz operator is bounded on Ll^iU , dVp) . 

3.3. Vanishing Carleson measure. Suppose that /i is a Carleson measure for L'p{U, dVp). 
We say that /i is a vanishing Carleson measure for L^{U, dVis) if 

lim / \h{w)f dp{w) = 

whenever {f^} is a bounded sequence in Lp{U, dV^) that converges to uniformly on each 
compact subset of U. 

The following theorem is a generalization of [121 Theorem 11] to a minimal bounded 
homogeneous domain. 

Theorem 3.3. Let p be a finite positive Borel measure on lA. Then, the following condi- 
tions are all equivalent. 

(i) p is a vanishing Carleson measure for L^{U,dVi3). 

(ii) p{z) as z ^ dU. 
(Hi) p{z) — 7- as z — 7- dU. 

Proof. First, we prove {i) =^ {ii). In the same way as in [U Lemma 1] and [H Lemma 
5], we can see that {ki^^} converges to uniformly on compact subsets of W as z — dU. 

Therefore, {ki^\w)p} is a bounded sequence in L^{U,dVf3) that converges to uniformly 
on each compact subset of U. Hence, {ii) holds. The part {ii) =^ {Hi) follows from 
(13. 6p . Finally, we prove {Hi) =^ {i). Take any bounded sequence {/„} in L^{U,dVj3) 
that converges to uniformly on each compact subset of U. Take any e > 0. Then, there 
exists a constant 6 > such that 

sup \p{z) I < £ 
dist{z,dU)<S 

by (iii). Let Us := {z E U \ dist(z, dU) < 6}. Since hl\Us is a compact set, there exists an 
integer such that 

sup \fn{z)f < e 

z&A\Us 
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for any n > N. Here, we have 



u Ju 



= C[ m \Uz)\^ dVp{z) + / m \Uz)\^ dVp{z) (3.7) 
\Ju\Us Jus J 

by Lemma Em Since y.{z) is a continuous function on lA\pls and U\pls is a compact set, 
there exists a constant Ms > such that 

sup Jl^z) < Ms. 

zeu\Us 

Therefore, the first term of (13.71) is less than or equal to CMsS ii n > N. On the other 
hand, since {/„} is a bounded sequence in L^(U, dVg), there exists a constant M > such 
that 

' \fn{z)f dVp{z)<M 
u 

for all n G N. Therefore, the second term of (13.71) is less than or equal to CMe. Hence, 
we obtain 



for any n > N. Therefore, we obtain 



\Uz)f d^i{z)<C{M + Ms)e 



n— >oo 



lim / \Uz)f d^i{z)=Q. 



Hence, {iii) =^ {€) holds. □ 

We can show that these conditions are also equivalent to the following condition (cf. 
[TTj Theorem 5.1]): (iv) The Toeplitz operator is compact on L^(W,(iV^). 

4. Relation between Carleson measures and composition operators 

4.1. Criterion of boundedness. From (12. 7p . is a bounded operator on 

L^iU, dVp) if and only if the pull-back measure yU<^^/3 is a Carleson measure for L^iU, (iV^). 
By Theorem 13. 2^ the property of being a Carleson measure is independent of p. Hence, 
the boundedness of on L^(W,(iV^) is also independent of p. We summarize the char- 
acterization of the boundedness of on L^{U, dVis) as follows. 

Lemma 4.1. Let j3 > /?min- Then, the following conditions are all equivalent, 
(i) C^p is a hounded operator on L^^iU , dVp) . 

{ii) The pull-hack measure ^^^p is a Carleson measure for LP^iU , dVji) . 
{iii) JI^p is a hounded function onU. 
i'iv) jApji is a hounded function onU. 
{v) The function 



F,,p{z) := / \ki^\w)\ dfi^A^) 



is hounded on lA. 
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Proof. The equivaliance of {i) - {iv) follows from Theorem 13.21 Moreover, [in) =^ (v) is 
trivial and (v) =^ (iv) follows from (13. Sp . □ 

If is bounded, we have the following estimate. 

Lemma 4.2. Assume that C^p is bounded on L^(U,dVi3) for some p > and j3 > f3o- 
Then there exists a positive constant C such that 

Ku{^{z),^{z))<CKu{z,z) 

for any z & U. 

Proof. By Lemma [4.11 it is enough to consider p = 2. By (12. 8p . we have 



KS'{z,z)^ 



Therefore, we have 

\\r*km? _ 4'H^{z),Az)) ( Ku{v{z\^{z)) V^' 

' "^^W Ki^\z^z) V Ku{z,z) ) ■ ^ • ^ 

Since C^p is a bounded operator on L^^iU, dVp) and || A;F^ ||L2((iyg) = 1, the left hand side of 
(14. ip is less than or equal to a positive constant C. □ 

Theorem 4.3. If is a hounded operator on LKU, dVp^) for some q > and /3o > /3min, 
then Cip is a bounded operator on L^{V(, dV/j) for any p > and /3 > /3o- 

Proof. The boundedness of on L1(U,dVi3g) (resp. L'^^ilA , dV^)) is equivalent to the 
boundedness of /vAj ^^"^ -^p,/3o (resp. fl^p and Fp^p) by Lemma 14. 1[ Therefore, it is 
sufficient to prove 

J^A^)>CFp^p{z). (4.2) 

Since 

by Lemma 14.21 we have 

dVp,{w) = Ku{w,wf-^° dVp{w) 

> CKu{ip{w),ip{w)Y-^'' dVp{w). 

Hence, we obtain 

= Ku{z,z)-^'-'M f dVp,{w) 
Ju 

>CKu{z,z)-^'+^^^ I \Ku{z,^{w))\'^'^^'^Ku{^{w),^{w)f-P-dVp{w). (4.3) 



u 
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By the definition of tlie pull-back measure, the right hand side of (14.31) is equal to 

CKu{z,z) ^ / \Ku[z,w)\ ^ — dVp[w) 

Ju \ \Ku[z,w)\ ) 

>c/<„(., |jy„(...)i''»^'( ^"';:7)^"'r' )"°'''^^w. (4.4) 

Jb{z,p) \ \Ku{z,w)\ J 

Since w G B{z, p), we have 



Ku{w,w)Ku{z,z) 
\Ku{z,w)f 



Ku{w,w) Ku{z,z) 



Ku{z,w) Ku{z,w) 
by Theorem 12.11 Therefore, (14. 4p is greater than or equal to 

CKu{z,zp'+^^ [ \Ku{z,w)f^'-'^^ dVp{w) = CF,A^). 

Jb{z,p) 

Hence, (g^]) holds. □ 

4.2. Criterion of compactness. Let p > 0. We say that is compact on LP^ilA , dVji) 
if the image under of any subset of L^iU, dV^) is a relatively compact subset. We see 
that is compact on L^iU, dV^) if and only if 

lim / ICJkHf dVp{w) = (4.5) 



holds whenever {fk} is a bounded sequence in L^{U,dVi3) that converges to uniformly 
on each compact subset of U (for the case that W = D, see [21 Proposition 3.1]). Since 
(14. 5 p is equivalent to 

lim / \fkiw)\^ dn^^i3{w) = 0, 



U 



C^p is a compact operator on L^iU, (iVg) if and only if /i^jj is a vanishing Carleson measure 
for L^{U,dVp). By Theorem 13. 3[ the property of being a vanishing Carleson measure is 
independent of p. Hence, the compactness of on LP^{U,dVp) is also independent of p. 
We note the characterlization of the compactness of on L^iU, rfVg). 

Lemma 4.4. Let j3 > /3min- Then, the following conditions are all equivalent. 

(i) is a compact operator on L^^iJA , dVp) . 

{a) f^ip,i3 is a vanishing Carleson measure for L^(U,dVi3). 

(m) lim /I^(2;) = 0. 

z—>-dU 

(iv) lim/v^(2) = 0. 

z—^aU 

(v) hm F,,^(2) = 0. 
z— >oa 

Theorem 4.5. If is a compact operator on Ll{hl, dV^o) for some q > and /?o > /3min, 
then is a compact operator on L^{U, dVp) for any p > and fi > Pq. 



Proof. By Lemma 14. 4|, it is enough to prove 

z^dU 

This follows from □ 



lim = ^ lim ^,,^3(2;) = 0. 

z—>-dU z—^dU 
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5. Some equalities 

5.1. Equality for a homogeneous Siegel domain. In order to characterlize the com- 
pactness of the composition operators on L^(W,dVa), we use an integral formula on a 
homogeneous Siegel domain. First, we recall notation and properties of the homogeneous 
Siegel domains following [1] and [5]. Let Q C MJ^ be a convex cone not containing any 
straight lines and F : C" x C" — > a Hermitian form such that F{u,u) E Cl(fi)\{0}, 
where 01(^2) is the closure of Q. Then, the Siegel domain V is defined by 



It is known that every bounded homogeneous domain is holomorphically equivalent to a 
homogeneous Siegel domain |1U] . 

Let I be the rank of f2. For 1 < i < /, let > 0, > and dj < be real numbers 
defined in [5] (These notations are also used in [1]. Note that dj in [7] is —dj in the present 
notation). We write n by the vector of M' whose components are rij. The notations q and 
d are used similarly. By using compound power functions defined in [5l (2.3)], it is known 
that the Bergman kernel of V is given by 

KAC CO = c - Fiv, v')) ~~ (C = (e, v\C = (r, i)) 



1<3<1\, (5.1) 



(see also [H Proposition II. 1]). For 

/3 > /3min := - mm <^ r 

[2{-2dj + qj) 

we consider the weighted Bergman space 

L^(I?, Kr,{C, Cr^dViO) := L^iV, Kt,{C, Cr^dV{0) n 0{V). 
By P Theorem II.2], we see that Ll{V, Kv{C, Cy^dViQ) ^ {0} if ([51]) holds. For 



Ant := max 



1<J<1 



2{-2dj + q,: 

Bekolle and Kagou showed the following integral formula. 

Lemma 5.1 ([U Corollary II. 4]). Let (3 > /3min and a > f3 + Ant- Then, one has 

I \K,,{CX')\''"' K^iCCr^ dV{C) = Cjy{a,(3)K^iCXr-^, (5.2) 
Jv 

where Cd{o.-,P) is a positive function of a and j3. 

We shall obtain an equality of a minimal bounded homogeneous domain from Lemma 

o 

5.2. Equality for a minimal bounded homogeneous domain. Let D be a Siegel 
domain biholomorphic to U and $ a biholomorphic map from U onto T>. We have an 
isometry 

Ll{V, Kr,{C, Cr^dViO) 9 / ^ det J($, O^+^Z o $ G Ll{U, dV^). 
In particular, Ll(U,dVfi) ^ {0} for /? > /3mm- 
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Lemma 5.2. Let (3 > 13^1^ and a > P + /3int- Then, one has 

[ \Ku{z, zOr^" |det J(<l>, ^Or^'''"" dV^iz') = Cr,{a, f])Ku{z, zy-^ |det J(<l>, 

for any z eU. 

Proof. Let C,' = $(2'). Since 

dV^^(2') = Ku{<l>-\C), ^-\C)r^ |det J(«l>^\ CfdViC) 
= |det J($, $-1(0)1"'^'^^^ i^i.(C',C')-^^^(C'), 

we have 

/ \Ku{z,z')\'^''\detJ{^,z')\''-'^~- dV^iz') 

= [ |K^(2,$-i(c'))r"'ndetJ($,$~'(c'))r^'^"^^^(c',c')"^^^^(c')- (5.3) 

Jv 

By transformation formula of the Bergman kernel, we have 



Ku{z, $-1(0) = KT,mz),C) det J($, 2) det J(<l>, $-i(C'))- 
Therefore, the right hand side of (15. 3p is equal to 

/ |A'^($(z),C')l'''"|det J{^,z)\'^'^KT,{C,Cr^dV{C). 
Jv 



By Lemma [5. 11 (15 .4^ is equal to 

Cv{a, 13) |det J(<l>, z) 1^+'^"" K«(z, 2)""^. 

Corollary 5.3. Let (3 > f3rain and a > (3 + /3inf For any z eU, the function 

l + a 1 + 2/3-a 

g,{w) := Ku{w,z) 2 detJ(<l>,w) 2 



is m L'^{U,dVi3). In particular, one has 

h\\L^(dVg) 



Ml^uv.) = Cvia, /3)Ku{z, zT"' |det J($, z)\'+''-- 



(5.4) 



□ 



Proof. We have 

ll^^llWv,)= / |i^^(^,^)r^"|detJ(<l>,u;)|i+^^-"i^^(^,«;)-^rfy(^i;). 
By Lemma E21 this is equal to C^ia, (3)Ku{z, z)''-'^ \det J{^, z)\^^^^~'^ . □ 



By using Corollary 15. 3[ we construct a positive function that satisfies the condition of 
Schur's Theorem (see [121 Theorem 3.6]) in section 
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6. ChARACTERLIZATION of the COMPACTNESS OF COMPOSITION OPERATORS 

6.1. Proof of the characterization of the compactness. By using the lemmas in 
section 16. 2^ we prove Theorem Rl 

Theorem 6.1. //C<^ is hounded on Ll(U,dVi3g), then the following conditions are equiv- 
alent for (3 > (3o + /3int- 

(i) is a compact operator on W^iU , dVp) . 



[a) lim 

z^dU 



0. 



Proof. It is enough to prove p = q = 2. First, we prove that (i) implies (ii). Assume 
that is a compact operator on L^iJA^dVp). Then, C* is also compact. Since {ki^^} 
converges to uniformly on compact subsets of W as 2; — dU, we have \\C^ki^'^\\i2(^^y^-^ 
as z ^ dlA. From (14. ip . we obtain (ii). 

Next, we prove that {ii) implies (z). For / G L^(W,(iV^), let 



Sf{z) 



{^{z),^{w))f{w)dVp{w). 



u 



Since is a bounded operator on L'^(U,dVi3), we have C^pC* = S hj (12. 9p . Therefore 
the compactness of is equivalent to the compactness of S. Hence, it is sufficient to 
prove that is a compact operator on L'^{U,dVi3), where 



S^fiz) 



u 



Kif\^{z),v{w)) f{w)dVp{w) 



for / G L2(W, dVp). For r > 0, let := {2 G W | dist(2, dU) < r}. We define 
Kl^{z,w) ■.= xu\Ur{w) k'^\^{z),^{w)) , 
K+^{z,w) := Xu\Ur{z) XUrM K^^\^{z) , ^{w)) , 
Kl^{z,w) := xuXz) XuXw) K^^\^{z) , ip{w)) , 

and Sj'^^ by integral operators on L'^iU, dVa) with kernel Kj'^.. Then, we have 

We will prove that S"^^ and S*^^ are compact operators on L'^{U,dVp) for any r > and 
||S'^j.|| — > as r — J- in section 16121 Using these results, we see that is a compact 
operator on L'^iU, dV^). □ 

6.2. Some Lemmas. In this subsection, we show some properties of the operators de- 
fined in the proof of Theorem 16. 1[ Since we assumed that is bounded on L^iU, c/Vsp), 
we have the following lemma. 

Lemma 6.2. The operators S^^. and o,re compact on L'^{U,dVj3). 

Proof. It is enough to prove K^^ and are in L^(W x U, dVp x dVp) (for example, see 
[T3| Theorem 3.5]). For w eU, let 

Kl'Uz):=Kli'\z,^{w)). 
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Then, K^^^. e Ll{U,dVp) and we have 



1^1 



U\Ur KJU 



U\Ur 



(6.1) 



Since C^^ is a bounded operator on Lp{U, dVis^), C^^ is bounded on Ll(U, dVg) by Theorem 
14.31 Hence, we have 



L-^idVp) 



< c 



K 



CK^f^ {cp{w),^{w))<CKuiw,w 



L-^(dVp) 



(6.2) 



where the last inequahty follows from Lemma [4.21 Substituting (16. 2 p to (16. ip . we obtain 



Similarly, we have A'g^^. 



< C 

= c 

< oo. 



Ku{w,wf+^dVp{w) 



U\Ur 



Kuiw, w) dV{w) 



U\Ur 



□ 



Assume that (3 > f3o + /3int and is a bounded operator on L^(W, dV^^). Then, we 
obtain Lemma 16.31 which plays an impotant role in the proof of Theorem 16. 1[ The 
assumption f3 > f3o + Ant is only used to prove Lemma 16. 3[ 



Lemma 6.3. For z G U, let 

h{z) := Ku{z, z)^-* |det J($, (^(^))|'+'^«"^ . 

Then, one has 

■ Kuiipiz),^{z)) ^ 
Kuiz,z) 



u 



h{z). 



u 



Kl^{z,w)h{w)dV^{w)<Cxw{z 
Proof. For 2; G W, we have 

K^.f.{z, w)h{w) dVi3{w) 

XuXz) XuXw) \Ku{^{z), ^{w))\'^^ det J(<l>, (^(«;))™'-^ dV^,{w 
Here, we define a holomorphic function Qz by 

gz{w) := {Ku{w,^{z)Y^^det J($, ^/;)1+2M|| _ 
Then, the right hand side of (16. 4p is equal to 



(6.3) 



(6.4) 



u 



Ur 



(6.5) 



u 
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Since /3o > Pmin and /3 > /3o + Ant, the function is in L^(W,(iV^Q) by Corollary 
Moreover, since C^^ is a bounded operator on L^(U , dVjj^^) by assumption, is bounded 
on L'^(U , dVj3g) by Theorem I4.3[ Therefore, we have 



< CxuM \\gz\\l2^av^^y (6.6) 

On the other hand, we have 

h^WUdv,,) = Ku{^{z),^{z)r-'^detJ{<^,v{z)y^'^^-^ (6.7) 
by Corollary [El Substituting ([621) to I^M>, we obtain (Q- □ 

As we have already noted, the following lemma completes the proof of Theorem 16.11 
Lemma 6.4. One has \\S^^r\\ — ?> as r — )• 0. 
Proof. Put 



M(r) := sup 



KiAz, z) 



u 



By Lemma [6.31 we have 

K+^{z,w)h{w) dVf^{w) < CM{r)h{z). 

By using Schur's Theorem, S^^ is a bounded operator on L'^{l/(,dVj3) with norm not 
exceeding CM{r). By (ii) of Theorem 16. 11 we obtain M(r) — )■ as r — ?■ 0. Hence we have 
11^3+ 11 ^ as r 0. □ 



7. Examples 
We apply Theorem |A] for some examples. 

7.1. The unit ball. Let 14 be the unit ball B'^. Then, we have / = 1 and rii = 0,di = 
— l,gi = d — 1. Hence, we have /3mm = Ant = 0. Therefore, we obtain the 
following; 

Corollary 7.1 ([TU Theorem 4.1]). Suppose f3 > — If the composition operator 
is hounded on L1{E>'^ , dVp^) for some —-^ < (3q < f3, then is compact on LP^^W^^dVp) 
if and only if 

K^d {^{z),(f{z)) 
hm — = 0. 

2^9B<* K^d[Z,Z) 

7.2. The Harish-Chandra realization of irreducible bounded symmetric do- 
main. Let Q be an irreducible bounded symmetric domain in its Harish-Chandra real- 
ization, r the rank of Q and a,b nonnegative integers defined in [8]. Then, we see that 
/ = r and Uj = a{r — j),dj = — 1 — "-^^'^^ ^ q- = Jj for 1 < j < r. Hence, we obtain 
Anin = ^jj and Ant = whcrc := qj — 2dj = a{r — 1) + 6 + 2 is the genus of VL. 
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Corollary 7.2 ([HI Theorem]). Suppose (3o > —jj- If the composition operator is 
bounded on LJ^(r2, rfVg,J for some q > and I3q + < (3, then is compact on 

LP{fl, dVp) if and only if 

Kn{ip{z),ip{z)) ^ ^ 
z^an Kn{z,z) 

7.3. The polydisk. Let U be the polydisk := ro x ■ ■ ■ x D. Then, we have / = m and 
Uj = 0, dj = —1, Qj = for 1 < j < rn. Hence, we have /3min = — | and /3int = 0. 

Corollary 7.3. Suppose [3 > —\. If the composition operator C^p is hounded on L^(D'^, dVp^) 
for some —^<(3o<f3, then is compact on L^(ro'^, (iV^) if and only if 

7.4. A nonsymmetric minimal homogeneous domain. Let be the tube domain 
over Vinberg cone. It is known that Tq is a nonsymmetric homogeneous domain (see [2]). 
By P, Proposition 3.8], the representative domain U of Tq is a nonsymmetric minimal 
bounded homogeneous domain with a center 0. In this case, we have / = 3 and n = 
(2,0,0),d= (-2,-f,-|),g= (0,0,0). Hence, we have /3min = -| and Ant = j- 

Corollary 7.4. Suppose /3o > — | and the composition operator is bounded on LliU, (iV^g). 
For /3 > (3o + ^, is compact on L^iU, dVg) if and only if 

hm = 0. 

z~¥dU Ku{z,z) 

Acknowledgment. The author would like to express my gratitude to Professor H. Ishi 
for advices and suggestions. The author would also like to thank to Professor T. Ohsawa 
for helpful discussions. 

References 

[1] D. Bekolle, A. T. Kagou, Reproducing properties and L^-estimates for Bergman projections in Siegel 

domains of type II., Studia. Math. 115, (1995), 219-239. 
[2] D. Bekolle, C. Nana, -boundedness of Bergman projections in the tube domain over Vinberg's cone, 

J. Lie Theory, 17, (2007), 115-144. 
[3] C. Cowcn, B. MacClucr, Composition operators on spaces of analytic function, CRC Press, Boca 

Raton, 1994. 

[4] M. Englis, Compact Toeplitz operators via the Berezin transform on bounded symmetric domains, 

Integr. Equ. Oper. Theory, 20, (1999), 426-455. 
[5] S. G. Gindikin, Analysis in homogeneous domains, Russian Math. Surveys 19-4, (1964), 1-89. 
[6] H. Ishi, C. Kai, The representative domain of a homogeneous bounded domain, Kyushu J. Math. 64, 

(2010), 35-47. 

[7] H. Ishi, S. Yamaji, Some estimates of the Bergman kernel of minimal bounded homogeneous domains, 

J. Lie Theory, 21 (2011), 755-769. 
[8] X. Lu, Z. Hu, Compact composition operators on weighted Bergman spaces on bounded symmetric 

domains, Acta Math. Scientia, 31B(2), (2011), 468-476. 
[9] M. Maschler, Minimal domains and their Bergman kernel function. Pacific J. Math. 6, (1956), 501- 

516. 

[10] E. B. Vinberg, S. G. Gindikin, I. I. Pjateckii-Sapiro, Classification and canonical realization of 
complex bounded homogeneous domains. Trans. Moscow Math. Soc. 12, (1963) 404-437. 

[11] S. Yamaji, Positive Toeplitz operators on the Bergman space of a minimal bounded homogeneous 
domain, to appear in Hokkaido Math. J. 



COMPOSITION OPERATORS OF A MINIMAL DOMAIN 



17 



[12] K. H. Zhu, Positive Toeplitz operators on weighted Bergman spaces of hounded symmetric domains, 

J. Oper. Theory, 20, (1988), 329-357. 
[13] K. H. Zhu, Operator theory in function spaces, second edition, Amcr. Math. Soc, Mathematical 

Surveys and Monographs Vol.138, 2007. 
[14] K. H. Zhu, Compact composition operators on weighted Bergman spaces of the unit ball, Houston J. 

Math., 33, (2007), 273-283. 

Satoshi Yamaji 

Graduate School of Mathematics 
Nagoya University 
Chikusa-ku, Nagoya, 464-8602 
Japan 

E-mail address: satoshi.yamaji@math.nagoya-u.ac.jp 



